Papers with vision-based pragmatic question answering
Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts (2026.findings-acl)
Copied to clipboard
Jaehee Kim, Ji Hoon Chung, Seoyoon Park, Unsol Kim, Kyungwon Park, JiHak Kim, Yi-Jun Chen, Hansaem Kim
| Challenge: | Existing benchmarks focus on explicit context, but do not address context-dependent pragmatic understanding. |
| Approach: | They propose a benchmark for evaluating ISA understanding through integrated reasoning over visual context and dialogue. |
| Outcome: | Experiments show that state-of-the-art models struggle with visually grounded indirect speech acts . linguistic meaning emerges through the relationship between an utterance and situational context . |